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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a satisfactory operation 
environment, without giving sense of discomfort to a client, while 
setting plural interspersed image pickup possible areas within a 
range where an image can be picked-up by an image pickup 
direction changeable camera. 

SOLUTION: Multiple image pickup possible areas are set within the 
range, where a pan angle and a tilt angle by one camera are 
changeable in a camera server. Then each virtual camera is 
assigned to respective each set photographing possible area and 
information, indicating each virtual camera and the photographing 
possible area assigned to it is stored as a camera control restricting 
list. Then it is presented as through the plural cameras are 
connected to the camera server as seen by the client. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image pick-up server, the client, the control approach, system, 
and storage which deliver the image information picturized and acquired with the image pick-up means on networks, 
such as the Internet. 
[0002] 

[Description of the Prior Art] There is a system which can observe the image of the video camera which is one of the 
image pick-up means from the many points of a remote place. And the applicant for this patent prepared the server 
(camera server) which picturizes a camera, and the client linked to the server on the general-purpose network, and 
proposed some techniques which it not only observes the camera image of a camera server, but enable remote 
operation of whenever [ pantilt angle / of the camera ], a zoom scale factor, etc. by the client side. 
[0003] The general-purpose network in this case is the network typical Internet which used for example, the TCP/IP 
protocol. And it connected with the personal computer (following, only PC) at it, and the configuration of the above- 
mentioned server connected the camera in which computer control is possible, and was realized by carrying the 
program used as a camera server on it. Moreover, in a client, a WWW (World WideWeb) browser makes it operate 
and the angle type of a camera server is operated through a graphical user interface. However, it is only one client that 
the camera of a camera server can be operated by remote control, and a camera server delivers the same image 
picturized to two or more connected clients. 
[0004] 

[Problem(s) to be Solved by the Invention] In such a system, it may be necessary to prepare the range which may be 
picturized, and the range which is not so. A reason is because it leads to problems, such as privacy, when whenever 
[ pantilt angle ], and a zoom scale factor are operated by remote control and the zoom scale factor in a certain specific 
include angle (direction) has been made very high. 

[0005] even narrowing rather than the movable range of a physical camera for such privacy protection ~ a camera - 
it is required to prepare a limit in the operational range. This operational range (a camera is not the range which can 
be changed potentially) was that to which sets up an upper limit and a minimum to whenever [ pantilt angle ], or a 
zoom scale factor, and a range limit is applied simply. 

[0006] That is, it is theta (it considers as what has a large value, so that a pan is carried out to the right) about a pan 
include angle. 

Whenever [ tilt angle / phi ] (it considers as what has a large value, so that a pan is turned up) 

Zoom scale factor z (it considers as what has a large value, so that a scale factor is large) 

When carried out, the operational range was set, for example as one field as follows. 

theta min<=theta<=theta max (a thetamin:pan include-angle left end, thetamax: paninclude-angle right end) 

phi min<=phi<=phi max (phimin: whenever [ tilt angle ] a minimum, phimax: paninclude-angle upper limit) 

zmin<=z<=zmax (a Zmin:zoom scale-factor minimum, zmax: zoom scale-factor upper limit) 

however - although it may exist [ actually, discretely / the range (field) which may be picturized or the range which 

is not picturized /, i.e., at intervals, and ] and the upper limit of a zoom scale factor may be high in the specific range - 

- other than this - coming out - the upper limit of a zoom scale factor cannot meet the request of wanting to stop low. 

[0007] Moreover, usually in such a system, the manager who sets up the operational range in a camera server differs 
from the operator (camera user) of a client side who operates a camera. Therefore, if a manager sets up a complicated 
operating range and it will be made the operator of a client, there is also a problem of in which range (field) a zoom 



scale factor and the visible range being restricted how and becoming incomprehensible intuitively. 

[0008] Furthermore, to be able to set up the operational range flexibly more intelligibly also for a manager was 

desired. 

[0009] 

[Means for Solving the Problem] This invention is made in view of this trouble, though two or more fields with which 
it is dotted within limits which can be picturized as it is also with an image pick-up means by which the image pick- 
up direction can be changed and which can be picturized are set up, does not tend to give any sense of incongruity to 
a client, but tends to offer the image pick-up server which can offer a good operating environment, a client, the 
control approach, a system, and a storage. 

[0010] In order to solve this technical problem, the image pick-up server of this invention is equipped with the 
following configurations. Namely, it is the image pick-up server which performs distribution service for the image 
information which has an image pick-up means and was acquired by the image pick-up means concerned to a client 
through a network. Two or more fields used as the candidate for service which can be photoed are set up within limits 
which can change the image pick-up direction by said image pick-up means. A storage means to memorize the 
information which specifies two or more imagination image pick-up means as the information about two or more set- 
up fields which can be photoed, and each of each field which can be photoed, The information corresponding to the 
imagination image pick-up means by which selection directions were carried out is read from said client from said 
storage means. The range of said image pick-up means which can be image pick-up direction changed is set up as it is 
also at the information about said field which is shown using the read information concerned and which can be 
photoed, and it has the control means which controls said image pick-up means within limits which can, be concerned 
image pick-up direction changed. 
[0011] 

[Embodiment of the Invention] Hereafter, the operation gestalt which starts this invention according to an 
accompanying drawing is explained to a detail. 

[0012] When the outline of this operation gestalt was explained briefly and one camera connected to the camera 
server is seen from a client side, it shows as if they were two or more cameras. 
[0013] Drawing 1 is the block block diagram of the system in this example. 

[0014] While 1-1 displays camera server equipment (only henceforth a camera server) among drawing and 1-2 
displays the image from the camera server 1-1, it is the display operating station (henceforth a client) which operates 
a camera by remote control, and these are connected by the network 1-3. 

[0015] Now, the camera server 1-1 receives the camera control command from a client 1-2, and controls the zoom 
scale factor and the movable universal head 1-12 of a video camera 1-11 while it incorporates the image from a video 
camera -1-1 1 and performs delivery to client equipment 1-2 (a pan angle and a tilt angle can be changed in operating 
the movable universal head 1-12). 

[0016] In addition, although it shows the camera server 1-1 and one client 1-2 at a time in illustration, a limit does not 
have them in this number. It is for giving explanation an easy thing. A camera server and a client also explain the 
following explanation as that whose number is one, respectively. Moreover, the class will not be asked if it is digital 
networks with sufficient band to let the camera control signal described later and the compressed video signal pass 
also about a network 1-3, such as the Internet and intranet. 

[0017] However, when you assume a TCP/IP (UDP/IP) protocol as a network protocol in an operation gestalt and you 
call it the address below, suppose that an IP address is pointed out. moreover, the camera server 1-1 and a client 1-2 - 
both IP addresses shall be assigned 

[0018] Although the camera server 101 can be constituted from a personal computer The zoom scale factor of 
movable universal -head equipment 1-12, and a video camera 1-11 and movable universal-head equipment 1-12 which 
controls whenever [ pantilt angle / of the universal head of a video camera 1-1 1 and a video camera ] like illustration, 
Whenever [ pantilt angle ] The camera and the universal -head control section 1-13 to control, the image input section 
1-15 which incorporates the image from a video camera 1-11, the incorporated image compression zone 1-16 which 
carries out an image data compression, the communications control section 1-14 which delivers compressed image 
data on a network, The command from the client 1-2 in one to network 3 course is interpreted, and it consists of 
storage 1-18 used for the data delivery of command interpretation / activation section 1-17 and each part which 
controls each part of camera server equipment. 

[0019] In addition, the image input section 1-15 incorporates the NTSC video signal from a video camera 1-11, 
compresses it by MotionJEPG after A/D conversion, and is passed to the communications control section 1-14. 



Although considered as MotionJEPG compression as a compressed format of an image here, not only this but of 
course, what kind of compressed format is sufficient. 
[0020] Next, the camera client 1-2 is described. 

[0021] Like [ this client ] a server, it can constitute from general -purpose information processors, such as a personal 
computer, and it is received through the communications control section 1-21, and is elongated in the image 
expanding section 1-25, and the compression image data delivered from the camera server 1-1 are displayed in the 
graphic display section 1-26. Moreover, it has come to be able to perform camera control, image storage preservation 
actuation, etc. by actuation of the user interface on camera client equipment. The display and control section 1-24 is 
performing control of these screen display and actuation. 

[0022] The bit mapped display is contained in the graphic display section 1-21, and a screen (user interface) like 
drawing 2 can be constituted. The window system was used as the graphic display section 1-21 in an operation 
gestalt. As this system, there is Windows 95 of U.S. Microsoft Corp. or X-Window of UNIX. 

[0023] In drawing 2 , the graphic display field where, as for 2-1, an image is displayed, and 2-2 are the camera control 
panels for camera actuation, and this is displayed in a window format. 2-22 in the camera control panel 2-2, 2-23, and 
2-28 are scroll bars, and can operate a zoom scale factor now whenever [ pan include-angle / of a camera /, and tilt 
angle ], respectively. A scroll bar 2-21 is an object for pan angle actuation, and it is used in order to publish the 
assignment command of the pan angle over a camera server by moving the knob of the rectangle currently displayed 
into the bar to right and left with pointing devices, such as a mouse, (it being called drag actuation generally). In 
addition, the display position of a "knob" shows the current location in the actuation limit field of a pan angle. It is an 
object for tilt angle actuation, a scroll bar 2-28 is an object for zoom scale-factor actuation, and the semantics of the 
location of operation information and each knob of a scroll bar 2-23 is the same as that of the scroll bar 2-21 for pan 
angles. 

[0024] However, since the user of two or more clients can regard the image from the same camera of the same camera 
server as having explained previously, it is only one client to have the place of a join office and a right of actuation. 
Therefore, at other clients, a scroll bar 2-21, 2-23, and 2-28 are displayed with a gestalt as shows that it is actuation 
disabling (for example, it displays thinly). Moreover, although it is the method of acquisition of the right of actuation, 
the actuation initiation carbon button 2-21 of illustration is performed by directing with a mouse etc. Directions of this 
carbon button publish the right acquisition demand of actuation to the camera server of a connection place. If other 
clients which have already published the right of actuation exist, a camera server publishes an improper notice to a 
demand, and when this demand is received, if it does not exist, it will publish the right of actuation. However, a 
camera server publishes the notice which makes the right of actuation an invalid, when the time amount which has 
granted the right of actuation to one client is clocked and predetermined time progress is carried out. 
[0025] Explanation is returned to the user interface of drawing 2 . Among drawing, 2-30 is a camera change carbon 
button, and if this carbon button is pushed, a pull down menu like 2-3 1 will be displayed. In addition, in the case of a 
pull down menu 2-31, three kinds of cameras of a camera 1 - a camera 3 can be chosen now. not a camera (the 
number of cameras physical to the camera server in an operation gestalt is one) with this actual camera name but "the 
imagination camera" which states below - corresponding --****-- camera selection here - corresponding - "an 
imagination camera" ~ changing (selection) — it carries out. Moreover, the virtual camera name under selection shall 
be displayed on a carbon button 2-30. Furthermore, the list information on this "imagination camera" that can be 
chosen is transmitted from a server, when that client connects with a camera server. 
[0026] "An imagination camera" is explained using drawing 9 . 

[0027] the range in all the pantilt range that the camera 1-1 1 of the camera server 1-1 can actually boil a frame 9-3, 
and can be photoed which can be picturized is shown (however, a zoom scale factor is the range in the minimum scale 
factor). And the field where the field shown with a slash permits an image pick-up is shown. If it puts in another way, 
fields other than a slash show the field which must not be picturized on problems, such as privacy. 
[0028] Since the pan angle and a tilt angle can be changed, the camera 1-1 1 of thinking that one camera can change 
the angle type in the rectangle range will be natural if it is made into the user of a client. If it puts in another way and 
one camera will enable it to picturize in an inverted-L character field and the dispersed field like illustration, sense of 
incongruity will be given. Then, in order to make it not give this sense of incongruity, with the operation gestalt, the 
field which can be picturized was divided into some rectangle fields, and the imagination camera was assigned to 
each division field (12 illustration 9-11,9- nine three of -13). Consequently, if it is made a user, since it is visible as 
if the camera (imagination camera) of plurality (illustration three) was connected to the camera server 1-1, and each 
camera seems to be able to change that angle type freely by rectangle within the limits, it can avoid giving any sense 



of incongruity. The camera name displayed with the pull down menu 2-3 1 of drawing 2 shows this very imagination 
camera. 

[0029] Here, it is theta (it considers as what has a large value, so that a pan is carried out to the right) about a pan 
include angle. 

Whenever [ tilt angle / phi ] (it considers as what has a large value, so that a pan is turned up) 
Zoom scale factor z (it considers as what has a large value, so that a scale factor is large) 
If it carries out, the operational range of a certain specific virtual camera can be set up as follows, for example. 
[0030] theta min<=theta<=theta max (a thetamin:pan include-angle left end, thetamax: paninclude-angle right end) 
phi min<=phi<=phi max (phimin: whenever [ tilt angle ] a minimum, phimax: paninclude-angle upper limit) 
zmin<=z<=zmax (a Zmin:zoom scale-factor minimum, zmax: zoom scale-factor upper limit) 
For example, when it applies to the rectangle field 9-1 1 in drawing 9 , the imagination pan tilt operating range of a 
camera corresponding to this field serves as (thetamin, phimin), and (thetamax, phimax) in that diagonal coordinate. 
[003 1] Of course, (thetamin, phimin), and (thetamax, phimax) have fallen within the actuation range of the physical 
whole. In addition, with an operation gestalt, although the number of virtual cameras is set to three, it can crawl on it 
not only in this but logically, and it can also set up shoes. Moreover, the field which shows the operating range of a 
virtual camera may lap mutually. In addition, the ID number for virtual camera discernment shall be shaken at all 
imagination cameras. Internally, the camera operating-range table as shown in drawing 10 stall hold to the shared 
memory 3-43. Moreover, the physical camera connected to one camera server may be not only one but two, or more 
than it. In this case, the table shown in one a physical camera and physical drawing 10 is made to correspond. That is, 
the table shown in drawing 10 should prepare only the number of physical cameras. 

[0032] Drawing 3 is the process block diagram of this example. A process means the thing in multitasking operating 
systems, such as WindowsNT and UNIX, here. In the steady state, all these processes 3-11, 3-12, 3-21, 3-22, and 3-31 
shall work. 

[0033] Each process which is on the camera server 1-1, and operates is as follows. 

- Camera-control server process 3-11: perform control which outputs an instruction for the camera control instruction 
which the client process 3-3 1 which has a right of actuation published to reception and the camera control section 1- 
13. 

- Notice process 3-12 of a camera condition : detect conditions, such as whenever [ pan tilt angle / of a camera ], and 
notify to the client process 3-31. 

- - image acquisition / transmitting process 3-22 of managing the transmission place of an image server process 3- 
21 xamera image : perform incorporation and transmission of a camera image. 

[0034] In addition, the graphic display prohibition flag 3-41, the transmission place list 3-42, the camera control range 
limit list 3-43, and the camera status register 3-44 are formed in the shared memory used for delivery of data between 
processes. Moreover, the camera controlled restriction range register 3-45, the right flag 3-51 of a limit, and the 
camera list of number 3-52 are the registers for saving the data of a process temporarily. 

[0035] The detail of actuation of the process 3-1 1 to 3-22 on the camera server 1-1 is shown in flow chart drawing 4 , 
and 5 and 6, on the camera client 1-2, the client process 3-3 1 is operating and the detail of the actuation is shown in 
drawing 7 . In addition, the program corresponding to these flow charts is memorized by the stores (for example, hard 
disk drive unit etc.) which a server or each client has, and it will be loaded to main storage (Maine RAM), and will be 
performed. 

[0036] First, each process of a camera server is explained using the flow chart of drawing 4 -7. 
[0037] In addition, the thing of a format like drawing 8 as a packet will be generated, and it will be transmitted to a 
network 1-3 (although the format used by packets, such as TCP/IP and UDP/IP, will be used strictly, drawing 8 
described only packet information required for explanation of an example). 

[0038] First, a camera-control process and the notice process of a camera condition are explained using the flow of 
drawing 4 . 

[0039] If the camera-control server process 3-1 1 is started (step S400), the notice process 3-12 of a camera condition 
will be generated (step S402), and it will wait for the camera-control connection request ( drawing 8 (1)) from the 
client process 3-3 1 (step S403). Camera control command transmitted from the client process 3-3 1 which performed 
connection reception processing (Ack is returned) (step S404), and had connection when there was a connection 
request from the client process 3-3 1 ( drawing 8 (2) it waits for - (4) (step S405).) In addition, in connection reception 
processing, as explained previously, the list information on the imagination camera which a camera server has is 
notified to a client, and is got blocked and transmitted to it. moreover, at this time, if a timer set is carried out and a 
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certain fixed time amount (it is called "control **** time amount") passes, camera-control connection will be cut - it 
is like (step S407). 

[0040] Reception of camera control command ( drawing 8 (2) - (4)) controls whenever [ zoom scale-factor / of a 
video camera 1-1 1 /, and pan tilt angle / of movable universal-head equipment 1-12 ] through the camera control 
section 1-13 according to the command (step S409). Camera control command is received from the client process 3- 
31, and camera control according to a command is performed through the command interpretation section 1-17 and 
the camera universal-head control section 1-132 until control **** time amount finishes. In addition, the detail of the 
processing according to control command was shown in drawing 5 . As camera control command, in order to simplify 
explanation, it shall be either of the next instructions here. 
[0041] 

Pan include-angle variation order PAN It is a variation order whenever [ theta tilt angle ]. TIL phi zoom scale-factor 
variation order ZOM alpha, however theta, phi and alpha are the parameters showing a zoom scale factor whenever 
[ pan include-angle and tilt angle ], respectively, and, otherwise, the various ******* * ? such as backlight 
amendment, and an automatic focus, a manual focus value setup, omit explanation to this camera control command 
here. 

[0042] Furthermore, there is also the next instruction for an "imagination camera" change ( drawing 8 (5)). 
Camera change instruction SEL n (however, n shows the identification number of a virtual camera) 
At the time of a camera change demand instruction, the operating range corresponding to a virtual camera 
identification number is read from the camera control range limit list 3-43, it sets it as a camera controlled restriction 
range register and the camera status register 3-44 (step S502), and the value of the pantilt zoom calculated in the 
following procedure is initialized as an initial valve position of an imagination camera (step S504). The initial value 
of an imagination camera considers as the value of the center of the limit range about whenever [ pantilt angle ], and 
is taken as the value of the minimum scale factor of the limit range about a zoom scale factor. However, the pantilt 
zoom of the limit range may be defined beforehand and what is set to the value is sufficient. 
[0043] In addition, since it may pass through the field which does not permit image transmission during a virtual 
camera change (i.e., under camera pan tilt zoom modification), the image in the meantime sets the graphic display 
prohibition flag to ON so that it may not transmit (steps S503 and S505). When this image pinching prohibition flag is 
in ON condition, the information on "-1" is notified to each client that it mentions later as an identification number of 
a virtual camera. When it carries out like this and the directed virtual camera changes into the condition (a pan angle, 
a tilt angle, zoom scale factor) of having set up at step 502, a graphic display prohibition flag is set as OFF. This can 
perform delivery processing of an image now again. 

[0044] On the other hand, in a pan, a tilt, and a zoom demand instruction, when it confirms whether a zoom scale 
factor is the virtual camera actuation-within the limits whenever [ pan include-angle / which is contained in an 
instruction / and tilt angle ] (steps S5 1 1 and S521) and the value has exceeded the range, it resets to the upper limit 
(when a value is too large) of an operating range thru/or the value of a minimum (when a value is too small), and 
camera control is performed. 

[0045] After fixed time amount passes since camera-control connection initiation and control **** time amount is 
completed, connection cutting processing (S407) is performed and a camera-control connection termination 
instruction ( drawing 8 (8)), i.e., the instruction deprived of the right of actuation of a camera, is returned to the client 
process 3-3 1 in processing of this step S407. And it waits for a connection request to come again (S403). Although 
the camera-control server process 3-11 receives the camera-control connection request from the client process of the 
arbitration carried out similarly and camera actuation is realized, it is not connectable with two or more client 
processes at coincidence so that drawing 4 may also show. Therefore, connection-oriented connection [ like TCP/IP ] 
whose the connection of this is shall be made. 

[0046] While the notice process 3-12 of a camera condition generated at step S402 operates, a camera condition is 
always checked. It reads by asking a camera and the universal -head control section 1-13. whenever [ namely, / pantilt 
angle / of a camera ] - a zoom scale factor (= p, t, z) -- carrying out - While writing in the camera status register 3-44 
(step S422) See the condition of the graphic display prohibition flag 3-41 (step S423), and a camera condition will be 
made into "under a camera change" (virtual camera identification number n=-l) if a flag is ON (step S424). A camera 
condition (format of drawing 8 (9)) is notified to the client process 1-2 which has transmitted the image (step S426). 
[0047] Next, an image server process and image acquisition / transmitting process are explained using the flow of 
drawing 6 . 

[0048] If the image server process 3-21 is started (step S600), image acquisition / transmitting process 3-22 will be 



generated (step S602), and it will wait for the event from the client process 3-3 1 (step S603). Here, if an event is a 
graphic display initiation demand command ( drawing 8 (7)) (step S604), the transmitting agency address of the 
packet contained in the graphic display demand packet will be checked, and it will add to the transmission place list 
3-42 of images. If it is a graphic display termination demand command (step S606), the transmitting agency address 
of the packet similarly contained in the graphic display demand packet will be checked, and it will delete from the 
transmission place list 3-42 of images. In addition, the address of an image transmission place is held by list form at 
the image transmission place list 3-42. 

[0049] If image acquisition / transmitting process 3-22 is started, it will repeat the next actuation. That is, it 
compresses by incorporating as a frame of a camera image (step S622) (step S623), and if a graphic display 
prohibition flag is not ON (step S624), this compressed image data will be packet-ized in the format of drawing 8 
(10), and it will transmit to two or more addresses in the image transmission place list 3-42 (step S625). 
[0050] Next, the client process 3-3 1 which operates by the client side is explained according to the flow chart of 
drawing 7 . 

[0051] First, initialization processing is performed at the time of process starting (step S701), and a graphic display 
initiation demand is transmitted to the camera server corresponding to the address (it considers as "ADDRC" an IP 
address and here) of the camera server equipment 1-1 to connect (step S702). The packet format at this time is the 
passage of (6) of drawing 8 . 

[0052] If Ack does not come on the contrary from the camera server corresponding to ADDRC here (step S703), 
since it is the abnormalities in actuation — the address is wrong ~ a client process is ended (step S704). 
[0053] Moreover, since it will be a display success if Ack comes on the contrary (step S703), it waits for reception of 
an event, i.e., the input by a user's user interface, or the various packets from the camera server 1-1 (step S705). 
[0054] Here, he checks whether it is the condition which has already started camera control with the right flag 3-5 1 
(variable secured to RAM which a client has) of actuation (step S707), and if a user pushes the actuation initiation 
carbon button 2-21 (step S706), if it is [ be / it ] already under control, it will return to step S605. If it is not [ be / it ] 
under actuation, a camera-control connection request ( drawing 8 (1)) will be published to a camera-control server 
process (step S708), and it will wait for authorization (Ack) (step S709). If Ack comes on the contrary here, 
connection will be materialized to a camera-control server process, the right flag 3-51 of actuation in the storage 
section 1-29 of client equipment will be set (step S71 1), and actuation of the camera control panel 2-2 (the image 
pick-up direction modification carbon button and scroll bar) will be confirmed. In addition, a camera-control server 
process receives a connection request only at the time of the waiting step S403 for a camera-control connection 
request. 

[0055] Moreover, after carrying out connection formation and completing the "control latency time", a camera-control 
connection termination demand ( drawing 8 (8)) comes on the contrary from a camera-control server process, but if 
this is received (step S714), the right flag 3-51 of actuation will be cleared (step S715), and actuation of the camera 
control panel 2-2 will be made into an invalid (step S716). 

[0056] While actuation of the camera control panel 2-2 is effective, the camera control instruction corresponding to 
actuation of the camera control panel 2-2 is generated, and it is published by the camera server process 1-2 (steps 
S717-S71 8). In addition, when a camera is chosen from the camera change pull down menu 2-3 1 of the camera 
control panel 2-2, an instruction ( drawing 8 (5)) of a camera change is published (steps S719-S720). In addition, it 
omits about the generation process of an instruction here. 

[0057] To the client process termination demand (step S726) published by actuation of a menu etc., a graphic display 
termination demand ( drawing 8 (8)) is published (step S728), and a client process is ended (step S628). 
[0058] When a packet arrives and (step S721) and it are image data ( drawing 8 (10)) (step S722), after reading the 
compression image data in image data and performing expanding processing, the display image of the graphic display 
panel of 2-1 is updated using this image frame data (step S723). 

[0059] When an arrival packet is the notice of a camera condition ( drawing 8 (9)), the display position of the notch 
(knob part) of the scroll bar 2-21 which operates whenever [ (step S724) and pan tilt angle ], and a zoom scale factor, 
2-23, and 2-28 is changed into a corresponding location using the parameter contained in the packet. Moreover, the 
camera name corresponding to a virtual camera identification number is displayed on the camera change pulldown 
carbon button of 2-30. (This will have updated the information, when other client processes are operating the camera 
by remote control) . In addition, matching of a virtual camera identification number and a camera name uses what 
correspondence relation was notified to from the notice process 3-12 of a camera condition, however, the time (it is 
the case where a camera is moving to the range which can photo a virtual camera) of a virtual camera identification 



number being -1 - a virtual camera change it supposes that it is working and is camera changing to the graphic 
display panel 2-1 — it indicates by the purport. 

[0060] According to the operation gestalt the above result, one physical camera which a camera server has if it saw 
from a client, as if it would be two or more cameras (imagination camera) — visible - each virtual camera moreover - 

- at least, since a pan angle and a tilt angle can be freely changed if they are rectangle within the limits It can even be 
managed with the problem of privacy there at not knowing that there is a field where the image pick-up is restricted, 
and it can avoid also giving any sense of incongruity moreover. 

[0061] In addition, it explained in advance and it is also possible to form two or more cameras for a physical camera 
in one camera server. What is necessary is just to set two or more virtual cameras as each of each physics-camera also 
in this case. At this time, a camera server grants the right of actuation independently to a client about the physical 
camera to write. 

[0062] Moreover, what is necessary is in the case of the manager of a camera server, to carry out the direct control of 
the camera server, to edit a camera controlled restriction list, but to connect like a client, to notify to a camera server 
that he is a manager there (for example, for ID, a password, etc. to notify), and just to transmit the file of a limit list to 
a camera server with protocols, such as ftp. 

[0063] Or when it is a manager, the range frame which a physical camera has and which can change a pan angle and a 
tilt angle is displayed on a screen, and you may make it set the movable pan angle of a virtual camera and its virtual 
camera, and a tilt angle as each rectangle field by setting up many rectangles as it is also with pointing devices, such 
as a mouse, in it. Lessons is taken for a zoom scale factor from each rectangle field set up, for example, and it should 
just set up a upper limit and a lower limit with a keyboard, a mouse, etc. Of course, what is necessary is just to only 
operate the program for providing a manager with the above-mentioned actuation, when for that a manager logs in to 
a camera server side. 

[0064] Next, the situation that camera server equipment with two or more controlled restriction fields (two or more 
virtual cameras) and the camera server equipment which has not set up restricting especially are intermingled, and is 
connected to the network, respectively is explained using drawing 1 1 . 

[0065] In the situation that two or more camera servers exist, to show the user using a camera client the list of camera 
servers (displaying a list like drawing 12 ), and to enable.it to choose from the inside the camera server which he 
wants to see with pointing devices, such as a mouse, is desired. 

[0066] If a camera server is chosen by the user, a camera client will transmit a graphic display initiation demand, as it 
is in step S702 of drawing 7 . If this invention is used, two or more controlled restriction fields can be treated as a 
separate independent camera like other camera server equipments. For example, in the user interface of drawing 1 1 , 
each controlled restriction field of a camera server with same camera 1 - camera 3 corresponds. A camera 4 and a 
camera 5 are respectively different camera servers. 

[0067] this example - like - 1 camera server equipment — two or more camera controlled restriction range - that is a 
means to manage the field (for it to be called a "controlled restriction field") which restricted the range of whenever 
[ pantilt angle ], and a zoom scale factor - preparing - 2 — each limit field A control range limit is performed by 
setting up a pan left end include angle, a pan right end include angle, a tilt minimum include angle, a pan upper limit 
include angle, a zoom minimum scale factor, and a zoom upper limit scale factor. From 3 client process Each 
controlled restriction field is shown as if it was the separate independent imagination camera, respectively. From 4 
client process When changing two or more controlled restriction fields, a more realistic and flexible camera controlled 
restriction entry is made possible to the problem of privacy by what is treated as if it was two or more camera 
changes. That is, each camera control range limit field is a simple setup, and it is a concept of two or more 
imagination cameras, and since plurality can set up such a controlled restriction range field and those who set up a 
camera control range are seen also from a client process as a separate camera with which controlled restriction range 
differs that what is necessary is just to set up the controlled restriction range as a different camera, it becomes easy to 
do grasp of the limit range. 

[0068] In addition, with the above-mentioned operation gestalt, the base of what needs hardware called the means for 
connecting with a camera server in an image pick-up means and a network is realizable with general -purpose 
information processors, such as a personal computer, moreover — a client does not only have an image pick-up means 

- it is - fundamental hardware - a camera server - the same - it can build with general -purpose information 
processors, such as a personal computer. 

[0069] What is necessary will be just to have the program which the hardware to need is utilized [ program ] in short 
and operates equipment as a camera server or a client. Therefore, the invention in this application is attained also by 



supplying the storage which recorded the program code of the software which realizes the function of the operation 
gestalt mentioned above to a system or equipment, and carrying out read-out activation of the program code with 
which the computer (or CPU and MPU) of the system or equipment was stored in the storage. 
[0070] In this case, the function of the operation gestalt which the program code itself read from the storage 
mentioned above will be realized, and the storage which memorized that program code will constitute this invention. 
[0071] As a storage for supplying a program code, a floppy disk, a hard disk, an optical disk, a magneto-optic disk, 
CD-ROM, CD-R, a magnetic tape, the memory card of a non-volatile, ROM, etc. can be used, for example. 
[0072] Moreover, it cannot be overemphasized that it is contained also when the function of the operation gestalt 
which performed a part or all of processing that OS (operating system) which is working on a computer is actual, 
based on directions of the program code, and the function of the operation gestalt mentioned above by performing the 
program code which the computer read is not only realized, but was mentioned above by the processing is realized. 
[0073] Furthermore, after the program code read from a storage is written in the memory with which the functional 
expansion unit connected to the functional add-in board inserted in the computer or a computer is equipped, it cannot 
be overemphasized that it is contained also when the function of the operation gestalt which performed a part or all of 
processing that CPU with which the functional add-in board and functional expansion unit are equipped based on 
directions of the program code is actual, and mentioned above by the processing is realized. 
[0074] Moreover, although the camera was mentioned as the example as an image pick-up means in this operation 
gestalt, you may be the flat bed scanner limited to this. 
[0075] 

[Effect of the Invention] It becomes possible not to give any sense of incongruity to a client, but to offer a good 
operating environment, though two or more fields with which it is dotted within limits which can be picturized as it is 
also with an image pick-up means by which the image pick-up direction can be changed according to this invention as 
explained above and which can be picturized are set up. 



[Translation done.] 



* NOTICES * 



JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original precisely. 

2 **** s j 10ws the word which can not be translated. 

3 .In the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block block diagram of the camera system in an operation gestalt. 
Prawing 2] It is drawing showing the user interface of the client side in an operation gestalt. 
[Drawing 3] It is drawing showing the operating sequence in the system in an operation gestalt. 
[Drawing 4] It is the flow chart which shows actuation of the camera server in an operation gestalt. 
[Drawing 5] It is the flow chart which shows actuation of the camera server in an operation gestalt. 
Prawing 6] It is the flow chart which shows actuation of the camera server in an operation gestalt. 
Prawing 7] It is the flow chart which shows actuation of the client in an operation gestalt. 
Prawing 8] It is drawing showing a format of each command in an operation gestalt. 

Prawing 9] It is drawing showing the example of a setting of the field in an operation gestalt which can be photoed. 
Prawing 10] It is drawing showing the structure of the camera controlled restriction list in an operation gestalt. 
Prawing 11] It is drawing showing the system configuration of the modification in an operation gestalt. 
Prawing 12] It is drawing showing the camera list in the system of drawing 1 1 . 
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